\ 



DOCOHENT RESOHE 



ED 203 36B 

AOTHOB 
TITLE 

PUB DATE 
NOTE 



EDBS PSICE 
DE5CRIPT0PS 



t • CS 206 «I35 

Ddzierr David M., V . 

The Diffusion of Evaluation Methods among Public 
Relations Practitioners. 

7 Rug, 81 , 

3Up.; Paper pres^^ented at the Annual Meeting of the 
Association for Education in Jburn^i|4sm (64th> East 
Lansing, ni^ August 8-11, 1981) • ^il|||p^ 

MP01/PC02 Plus Postage. ^ 
*Behavi,oral Sciencfe Research: Comauiiication Research; 
♦ Decision Making/ *Evaluation Methods^ 
♦Organizational yCommunication: *Public Relations: 
*Staff Role • / - ' 



ABSTRACT : * 

A study explrored the ]:elationships between public 
rele>tions practitioners' organizational roles and the type of 
evaluation methods they used on the ^ob. Based on factor ajialysis of 
role data obtained from an earlier study, four organizational roles 
vere defined and ranked: communication manager, media relations 
specialist , communication liaison, and communication technician. 
Twelve measures of evaluation activities were developed from a 
conceptual model involving scientific (systematic, quantitative) 
versus "seat-of-the-pants" Csubiectlve, Individualistic) evaluation 
methodologies. Data were then collected on the organizational roles , 
and evaluation activities of 169 public relations practitioners in / 
San Diego, California. The coihiunication matiager, media relations, 
and communication liaison role scotes correlated slgnf iciantly with 
both scientific and "seat-of -the-pants" evaluation method scores. /^he 
communicatipn technician role score, however, correlated with neither 
the scientific nor the seat*of-the-pants/ evaluation method scores. 
The correlation between income and evaluation, activities was 
significant. It was' interpreted that the media relations specialists, 
who were at the middle management rank, used both evaluation 
metiiodologies^ bu.t tended to confine scientific evaluation methods to 
d;lsseminatibn evaluation. (RL) / 
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The use of social science methods to evaluate public relations • 
activities may be .hypothesilzed to follow patterns* of dfffusJon similar 
to other^ Innovations. Individual practitioners will be motivated by 
Internal ^and social forces to acquire knowledge of evaluation methods, 
be persuaded of their relative advantages, adopt the Innovations on a^ 
. ^f"'"^ basis, and decide to continue or ^discontinue their use,'' 

Professional and research literature related to public relations 
has long advocated, the adoption of social sc fence research methods to 
evaluate public relations activities. Perhaps the strongest call for 
adopt loh of Innovative methods was stated by Robinson, who defined the 
"publjc relations practitioner of the futW' as an "applied social 
and behavlo^al sclentlst.''^ The role-of j^ubl Ic relations practlttoner 
would become one of applying principles of social science' to accomplish- 
ment of organ I zat lonal objectives. / - 

Lewis argues from a different perspective, stating that public 
relations has "always been an applied social science,'*^ What the-^ro^ 
fesslon requires Is departure from Its un§ystematlc approach and toward 
Integrated r^Tlat Ions with the social scientific coonunlty. According, 
to Lewis, public relations is not a craft, but an applied science. / 

Such pronouncements are not necessarily greeted yiilth^enthuslasm/ 
by practitioners steeped In liberal arts tradltlonsyind values. Suchk"^ 
changes, according to Pennington, "sounded somewhat, dfg'it^^ arwJ duj Ntb 
marty of us fn public relations." The diffusion process 'I n^l>^reluc^ 
tant Innovators "being dragged, kicking and screaming, l/tq/the main- 
stream" of evaluation and organizational accountability.^ 
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In discussing evajuatlon In puWIc relations, Cutllp and Canter 
make note of the common retorts of "seat-of-the-pants" practlttdners 
who asseft that "public relations Is an art" or "we are dealing In 
Intangibles" or^'our. problems are Indistinct."^ Wright notes. In 
discussing practitioner responses to the need for measurement, ^hat 
many thought "tjiey should not be'measiired because they were artists 
r^tiiw tiwrmanagers."^ 
X ^.Evaluation, of public relations actlyltliss Is especially sensltrve, 
/because measurement of "Intangibles" may support- conclusions of Irre- 
levance of the public relations function. Robert Marker, a practitioner 
for the Armstrong Cork C6., noted a day of reckoning with management when 
Marker was asked to Justify the coming fiscal PR budget. Marker provided 
serveral hundred feet of\news cllpolngs as evidence of productivity, 
boastlns( that he could paper one and one-half walls of the marketing 
executive's office with clippings left over. The marketing executive 
leaned forward and asked: "But what's all this worth to us7" Markar's 
answer to that question was an Innovative reorganization of evaluation 
activities at Armstrong. ^ ^ 

In theoretical terms, resistance to the adoption of an Innovation 
can be thought of as a behavioral threshold , as an Individual- charac- ' 
terlstic that resists adoption and tends to maintain this status, quo .^ 

Social scientific evaluation of public rel at lon^ activities lacks' 
compatlblMty with existing organizational behavior for many practitioners. 
The complexity of the Innovation reduces opportunity for trial adoptIon i>f 
^Irjnovatlve practices. The relative advantage of adoption may also be 
questioned by n^ny practitioners. These are characteristic factors slowing 
the pr^ess of diffusion.^ • ^ 



PubUc Relat 1^5 By Objectives 
Much of t*)e Impetus for change In public, relates comes from 
outside the^ public relations unit, from the organljat'lon and from 
the environment. Specif Ical^ly, organizations find themselves under 
Increasing scrutiny apd demands from priority publics. A^envlron- 
mental uncertainty Increases, demands to evalijate the public relations 
function are hypothesized to lncrMseJ° Within the organization, 
managem^t by objective (MBO) has been widely adopted as an organisa- 
tional phMosoi>y,y As a consequence, managflotents are tending to 
view public relWns as^ proactive rather than as a reactive 'function. »2 
Accountability Is pushed downward through ^ he organizational structure, 
affecting staff activities previously untouched by such responslbll Ity. 
Public relations has come, to be regarded by many organizations as'lnhe- 
reritly effects oriented. m large corporations/ systems of full'charoe- 
ba^„ In which profit centers are billed the fu/T^t for public relations 
services received from the. I^\ernal PR unit, havVbin Implemented to tie 
the public relations function Inexorably to the "bottS^ llne."^^ 

Such change bodes 111 for practitioners who narrowly define them- 
selves as artlsans of ^the Inverted pyramid. As environmental uncertainty 
forces senior management to parf Iclpate In the public relatTons function, 
practitioners are fetreasJngly expected to think "time and money, set 
goals and establish priorities." The "Journal 1st- 1 n-resldeoce" Is now 
being required to plan approaches and execute according to. plan, rather 
thah reacting to the "Jatest squeaking wheel. »''^ 

The public relations function. In short. Increasingly Is b^ng viewed 
as a management function In many organizations. The communication and , 
other actfvltles of the public relations unit are planned, goal-orl^ted 



•ctJoni. .nd T. ^pected to achieve objectfvei of direct rllevnce 
to^tb'<^ org.nlz.tl^«.3 survival .nd growth. .Practitioners ire expected, 
to. make dec IsTo^TT they are^eld accountable foP'outccne. of their 

Such change Is correctly perceived a. threatening, to some prac- 
titloners hired on the basis of "Journalistic skill,, experience and 
■ contacts.'.^7 ^^^^^ ^.^^^^ writers d<i not necessarily 

beopme successful managers."'® 

Evaluation and Public Relations . 
Methods of Evaluation are Indicative of a larger problem. solving 
approach: Roblion argues that publ Ic relet lons'as a profusion I. 
•>3>lymg along jiaths previously^ rave Vied by mcuilclhe and engineering. 
Sp.clflca11y, public relations pVacMt loners, have traditionally «xlyed 
probl«,^ by depending on their -'own, Judfl£?,t, realizing fuU'w^l that 
rel labia Jcnowledge is extremely ll.Ited.-'S Professional Judgment, per - 
h.p. confirmed thrcdgh consultation ^^Ith anot'her practltloper, becomes 
;.th* prImarV probi em-sol v log mechanism. Robinson descrtl|es this Indivi- 
dual approach to problem-silying as the "seat-of-the-pants" school. 
Prob1«„.«>^^,ng Is subjective, Intultiv,, personal and llr^ly unencum- ' 
bered or assisted by the soolal sclences.^^ 

As has occurred In medicine and engineering, public relation, at the. 
.social level pf analysis ^ moving on a continuum toward^hat Robinson 
calls the ".clentlflca^ly-derlveS knowledge stage.". Because public " ' 
relations goals generally Involve change or malntenanVof Jcnowledge ' 
level., attitudes and/or behavior of publ Ics, the function Is facilitated 
by advances In the spclal sciences of cd^nunlcatlon, psychology; «,cIo1ogy, 
economic, and others. As pure research brings sophfstI^tIo« to our 



und«r«t«ndfrtg of human attitudes. and behavior, public, delations, at * 
an applied professlonel of social science, becomes Incr^slngly 
objective, rlgarous, empirical and theory based In so>Jng problams;*' 
EvaluaHon and measurement In pubjfc relations have provMed fer- 
tile^ soil* f|fei^ 'theory construction. Contingency models, coorlerftyttlbn 
models and open- vs. closed-system theory have been Invoked to.expla/ 
the research and evaluation funcilons In public relatlons.^^ 



Here, a narrotinr focus Is at play. The evaluation function Is 

conceptualized as Involving two methodological approaches and three 

conteivt areas After Roblnsori,^^ the tvyo methods of evaluation are 

dichotomized: as ^'^her sclentilj[lc or Individualistic . Dichotomizing 

evalyatlon methods *ln this way simplifies Robinson's model of a con- ^ 

tlpuu^ of approaches to problj^m-soKlng, and at the samb time distorts 

.* ' -J - ) ■ 

Its Intent; Howeyer, measurement Issues outweigh th^e concerns; 

dichotcmlzing the contln^ provides base for rough exploratory testing. 

This stjtdy opera tlohaT I zes. two metfc)d$-o^ evaluation. ^After * * 
Robinson, thfe scientific method Involves systematic and liantltatlve data 
collectlbn^ and analysis. Informatljon> Is a' shared resource; procedures 
are subject to rep 1 1 cat Ion. Such meth<iis/are Inherently bVjfectlve. The 
Individualistic or seat-of-pants method Involves highly Individualized 
approaches to evaluation."" Such methods are not systematic: hu/tches, 
guesses and "gut" reactions aH^fall urider this category. Information ' 
ls^.^red only -to the degree that other practitioners, looking at the . V 
same pJtjblem, may apply similar hunches, guesses and '•guf'^reactlons. 
SubJectlveNeyaluatlon Is favored; hoi 1st Ic conclusions are accepted 
without evidence. ' » 

Three content areas are operational Ized. Pr6jgarat_Ion evaluation 

Involves the adequacy of background Information during tlie planning 

(J 



process, the organlzatton of meftsfiges and thejr presentation. Content, 
styli, ftin^t and packaging of public relations cocnmun feat Ions are 
tnclude^~^ prepapatlon ev)sluatlon; ' ' " / 

Olssemfnatlon evaluation Involves the placement of messages, counts 
^ of people receiving the messagel and attendance tS the InfonJ'atlon pro^ 
Wvlded. Distribution, media placement, coverage, reach, opportunity 4or 
exposure, readership, viewershtp. llstenership and attendance are all 
part of dissemination evaluation. 

Jmfiact evaluation IrtS^olves assessment of kndwledge^level. attitude 
and- behavioral change (or maintenance) among publics. The number of 
people who learn the content of a message, the number who change attl- 
/tu<^|BS. the number who act In a. desired way - al jTmay be subjects of , * 

Impact evaluation. Thus. Information gain, Increased awareness, *^ 
• Increa^e^nderstandlng, sliuaf lon and cross-sltuatlonal evaluation. • 
behavioral change, adoption, cultural .Integrat Ion and. social' support are 
all Indicators of Impact. *( - 

^ 'Given two methodological approaches to public relations ^valuation 
^<id three areas of evaluation content, a Wtrlx qan be constructed to 
IncWate six discrete cells of evaluation activities. SucJ^ a fKikllc 
relatl^ySvaluat Ion ^matrix Is provided In Figure 1. Within each c^l 
of the matrix Is a conceptual description of the type of act^jrjty whrtJT- 
would typify such evaluatloi^. 

F^om the conceptual descriptions In the publ Ic^relat Ions evaluation 
matrix, behavioral measures can be operayonall zed. That Is. specific 
practitioner activities were Identified through a review of the literature 
and discussions with practitioners which fit the characteristics of each 



Public Relittons Evaluation HatrU 
. Contant.of Evaluation 



Preparation 



Dlsimlnation 



Impact 



Coniiunication 
activities prepared 
, via application of ' 
internalized 
professional ' 
standards of 
quality. 

< 

-.1 


DIsseniination of 
mes^ges evaluated 
by reactions of 
mass inedia professionals. 

\ 

•* 

r * 


k^ct of PR , 
activities evaluated 
via subjective, 
qualitative "sense" 
V publics' reactions. ' 

« 

>• 


Coflnunicatlon 

activities prepared ' 

via application' 
, of scientifically 

derived knowledge 
Uf publics. 


Dissemination or r 
messages evaluated 
1^ quantified 
measu^s of media' 
usage of iiiessages. 

\_ 

: \ 


Impact of PR 
' activities evaluated 
^yia objective, 
quantitative measure 
of publics' reactions. 

VI f 



. c«1I. Th«te operational maasures of evaluative activities were pretested 
with a convenience .ample of prect It loners, revised,- and Incorporated Into 
a survey Instrument. The actual Items are dllsplayed In Figure 2, organized 
by method, and by content area. Two Items were operational Ized for each 
cell of thi matrix. 

. Reliability coefficients (alpha) were computed for the combIne<i 
'^'y^^^'^ -valuation methods scale and the seat-of-pants evaluation methods 
scale.2 Alpha rel labll Ity coefficients were .79 and .75 respectively, v ' 
>/hen these scales were broken down by content areas to yield six scales . >' 
made up of tv^tems each, the following alpha values were calculaced: 
scientific preparation scale. .61.; seat^of-pants preparation scafe. .1,1; 
scientific dlssemlnatlon^scale. .77; seat-of-pants dissemination scale. 
.68; scientific Jmpa^ «cale. .5k; seat-of-pants Impact scale. .57. 

y The Research Quesglbn 



What are the relations between the t^ of organizational rples that 
public relations practitioners play and the types of evaluat lorv^ethods 
they use? ' 

The 12 Items displayed In Flgure-2 provide behavioral Indicators of 
methodologies and content' areas of public relations evaluation actlxjtles. ' 
Since use of social science ^search techniques are regarded as Innovations 
In public relatrqpis. one waild^antIcIpate an adopter typology along classic 
diffusion llnes.^conslstlng of 'innovators, early adopters, ealy majority, 
late majority and laggards. ^^^^^ ^ over 1.500 diffusion of Inno- 
vation studies synthesized by Rogers with Shoemaker/ characteristics of . 
Innovators distilled from prior research can l?e used to develop hypotheses 
about adoption of evaluation techniques. ' 

Innovatlveness with regard to evalual^n Is but one characteristic 
•mong many characteristics that distinguish one public relatf&ns 
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.pra5tftloi>er from another In terms of the organ Izatlonal roles they play, 
t^sfng identified roli^characterlstrc*. the postulates of drffuslon resMrch 
,can be used to, develop theory^based hypotheses about relationships between 
evaluation rnethods and or^anlzatronal roles, ' i ' 

, A flfjal poljit Is crucial . Evaluation m ai^y form, scientific ort 
seat-of-ftants. properly )s wldely^regarde* as Innovative. , A practitioner 
Is flr%t Innovative by adopting any mettedoipg lea evaluaeiph. 

^ As the raorelcomplek and demanding" tjaghn of ^cl6nt If Ic evaluat ion are v 
adopted, they sein/e to supplement Pather than rit^place ^seat-of-^p ants 
evaluation. Such. In any case. Is the MUderlylng assumption of the following 
liypotKeses. ^ ' ^ ^ ' . * " 

Organizational Rolgs. 

Measurement of organizational roles Is fadUtated by studies, by Broom?' 
and Broom ei« Smith . Based on experimental tests of organizational role 
models derived from the' literature and consulting activities, Broonv developed 
and pre-tested 2k behavioral Indicators of practitioner organizational roles. 
Broom developed iour conceptual, add I tTve^ scales from'the 24 Indicators. - 
»Ix measur^ to each scale. Data were collected f rom kSB respondents, syste-^^ 
matlcally sampled from^the national membership mailing list of ^he Public 
Relations Society of America. ^.^ . 

Unlike the Broom study, the current study uses empirical ly^der I ved scales 
of organizational roles, rather than a conceptual model. The B>oom data set 
was subjected to factor analysis to derive empirical models of organizational * 
roles. Using factor score coefficients derived from analysis of the Broom 
data set. weighted factor scales were developed. These organizational role 



scales are additive, as are the Broom Scales, but var fables used as 
measufes of the underlying organizational role were selected through 
observation of reported behavior rather than theory. Further, each 
variable Is weighted In terms of Its relation to the underlying role; 
virtables that are "better" measures of the underlying role are 
. ^<elghted to contribute more to the practltIoner'»s organizational role 
score.:. . • ' ' 

Jtom the Broom dat^ set, 355 practitioners were Included In the 
, 30 * ' " 

factor analysis. Four factors with eigenvalues greater than one 

were extracted and rotated to final configuration, They are Interpreted 



below. ^ 



Factor It The Communication Manai^r Role 

As Indicated In Table I, seven behavioral Items with high factor 

loadings serve as measures of the underlying organl5atIoJ»aI role. 

Analysis of these Items Indicates a senior, high-level organizational 

role. Practitioners with high scores on this role scale typify what 
CW and Marshall^ describe as the modern public relations practi- 
tioner. The communication manager role Is one of solving problems, 
of proactive and syst^atlc planning. What distinguishes this as a 
managertent role Is the .emphasis on dec Is Ion -making and accountabi I Ity' 
In this role, the pract It loner ^7lakes djfuions, rathe/than simply 
ImplemeiA decisions qf others. In the final analysis, the practitioner 
In this role Is held' accountable^or the success or failure of public 
retIatlons*>fforts. 

Prior diffusion Tesearch would Identify this role as favoring the 
Innovation of evaluation. In the^ppU of problem-solver, decision-maker 
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Factbr Loadtng* of Behavtopal Jndrcators for Cownun teat fon ^ 
Manager and Conmun rcat Ion Tejzhnfcran Roles 



TOR It Communication Manager Role 

Item D^scrfptton 

Because of my experience and train Tng^thers consider me 
Hhe organization's expert In solving PR |]fob1ems 




/ 



I take; responsibility for the success or failure of irty 

organ rzat ion's PR programs • * \ 

In meetings with n^nagement; I point oui the need to follow 
a systematic PR plannlAg process 

- • — * ■ , ■ 

I observe that others In the orga^atton hold me accountable, 
for the success or failure of PR prograns. ^ 

I operate as a catalyst In management 's declston-maklng. 

1^ make communication policy decfslons. 

I keep management Informed of public reactions to organizational 
poUcies^ procedures and/or actions. 



FACTOR 2: Communication technician Role 

. <■ 

Item Description * 

I produce brochures, pamphlets vend other publications. 

I handle the technical aspects of producing PR materials. 

I do pHotography.and graphics for PR materials, 

r am the person who writes PR materials prigsenting Information) 
on Issues important to the organization. 

I edit ^nd/or rewrite for grammar and spelling the materials 
written by others In the organlzat Ioq. 
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«nd planner, the pract Moner U pretHcted tojpercefie eyaluntton as 
relatrvejy advantageou Jj and compatlhle wHh ojher chlracterrstlcs of * 
the.rolei As the organ^tron^s publ k relatrjjns, ei(pLrt,^p«ctlt 
In thistle ere expectid to be. knowledgeable pf Jnnolatfons ?n public 
reJatlonsiand expected Jb demonstrate leadership fn niw approaches to 

old problems. All the^ factors would .paki practJtlo.)ers In this role 

prone to adopt Innovat loiis. 

Factor 2: The CommuhYteetlon Technl.tljiii b^i> . 



Table I displays f lyL behavioral Items that are highlyr loaded on 



the communication technician role factor. These Items .describe an . 
organizational role saturated with the artisan activities of tradi- 
tional publ Ic. relations, is Identified by Pennfngton,33 „^,ght3* > 
^ Coyle and Stephens , 

Pract 1 1 loners ^Plng the communication technician rol e are 
emersed In the mechanics of producing, brochures, pamphlets, n^ ' 
rel«ises. publications of all kinds, photographs and graphics They 
are performing a relatively technical task. Implementing commiinlcat Ion 
declslons'and plans made by others. (CommunTc^tlon technlr i.n 
tloners are unl Ikely to participate In decisionmaking or problem- 
solving activities). 

As artisans of the written word and graphics, prior diffusion 
research would suggest that practitioners with high communication 
X ^echnlclan role scores are likely to be late adopters of evalua'tlon 
' Inrjvatlons. Emersion In the craft of message generation Is I |kely to 
maki evaluation seem threatening, especially If such evaluation of the 
pubkc relations function Is new and unexplored. The Innovation Is 
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Ukely to be viewed as relatively dlsadvantage<iu$. As lndlcat0d by 
Pennlrpton, management's efforts to drive accountab 1 1 Uy to lower 
Staff functions In the or^i^nlzatioh may be Interpreted as threatening. 
As primarily non-numeric. -such artisans are likely to find evaluation 
iBnovatlons as deficient In eUmpatlbl I Ity and tra'Habll Ity, while 
complexity of the Innovation wHl be viewed as high. All these , • 
factors would Indicate aVak or nonexistent relation between the 
communication technician role and «|d<J|>t Ion ;of ii^luatlon methods. 
Factor 3; The Media delations Role! , 

• ' * ■ ^^^^^^^^^^^^^^ 

Table 2 displays three Items w|th high factor loadings on the 
media relations role factor. The t^ree Items loaded on this role - 
factor Indicate a sketchy prof Me oi the "Journalist- Inri'esldence" 
approach to p^bl Ic relatlons*.^^ the pract It loner with a high score . 

on the media relations role seal «i i< skilled In relations with the. 

mass media and serves as a conduit of Information back to the 

organisation about mass media coverage. 

Equally Informative are Items with negative loadings on the 

mfedta relations role factor.^ Infonning management of polling results 

(factor loading - -.16) and auditing communication problems i^lth 

IHjbllcs (factor loading - -.20) would suggest a pattern of avoiding 

evaluation activities. 

Factor k: The Communication Liaison Role 

Table 2 displays three Items wltH heavy loadings on the communt"- 
catlon liaison role factor. \ Ike the media relations role fa«=t«r/ / 
the Item; provide only a sketchy outtlne of the underlying org^Iza- 
tlonal role. While t|ie media' relations role stresses mass mediated 

■ ■ ■ ( ' . 



Factor Loadings of Bahavloral Ind-icators for 
Nadia RalatTons andXonvmintcat Ion Liaison Rolas 



FACTOR 3: Hadia Relations Role 



Factor 
Loadings 

.69 
.35 



/ 



ttam Dascrlptloo 

I maintain madia contacts and*, place jpress ra1aasas(l 

t keep others In the organlzatlorf Infom^ of what the ^ ' 
media" repprt about our organisation and Itff|^^ant; Issues. 

I keep management Involved J^ >very phase ^f the PR program < 



: ... r 



§ Factor .. 
Loadings 

M 
.40 

. .40 



FACTOR ki Cqmmunfcatloh Liaison Role 



Ittm Description 

H represent the organ laiat ton at events n^A meetings. . r-^ 

. ■ ■ S'l • 
I create opportunities for managanent to/ the Views of 

various 'Internal and. external publics^ y : / 

When working with managers on P'R,^ I 
approaches for solving prot)lems. 
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coBWHinlcatlon, the conrc/nlcatlon Itarspn role stresses Interpersonal 
communication activities. - , • 

Furthi-, the communication liaison role app^s rented to the 
■ problem-solving process. In an advisory capacity. Outlining alter- 
natives to manaigers (factor loading - .hO) couples with other 
behavioral Indicators ^ suggest that ^h Is ri^le facilitates the pro- 
cess of decision-making and problem-solving. However, the practi- 
tioner wltj-^a ihigh communication Malison role score does 'not* make 
deb I srws: (factor loading - -.06) and Is not held accountable for 
success^ or<?aTlures (factor loading - -.06). • 

As such, practitioners with high ccimnunlcatlon liaison scores 
- differ from communication manai|er« In terms of d;Bd$IonrnJakIng respon- 
, s.|bIIItY. ^'^'^^^^^^ 's « characteristic Imposed in the practitioner 
by the organ IiaBonal context or a position actively fought by the 
practitioner Is uncertain. However, as^ jidVlsbr to the decision- 
making and problem-solving process, the camnunlcatlon liaison role ' 
would appear conducive to adoption of evaluation Innovations. 
>>^ct It loners playing the communication liaison role would ITkely 
(»rciBf^v^reIaUve,advantage to Evaluation Innovations, sljice evalua- 
^t lon and measuremeht;^rf . key trf .succossiFur prqblem-sofvlng.^® Ad6p-* 
tlon of evaluation Innovation^ would be compatibly with th* problem- 
solving characterslttcs of the role. 39 ' ' ■) 

Implications of Role Scores ^' * 

Factor analyzing Broom's data*\^^vldes methodological rigor to 

the presentlstudy, because development of ''the measurement scales Is 

/■ ^ . - '■ . 

conducted onyiata separate from those upon, which hypotheses are tested. 
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Analysis of the Broom data yfelded formulas for calculating each 
rasponrfent's score on the ccmmun^lcatlon r^n^r^.r cownunlcatlon . 
technician , media relations and communication 11 a Unn sc<il es . 

^ Inherent In R-/^ctor analysis is the^assumptlon that each ^ 
respondent possessesSach organizational rol«^ to some degree. This . 
assjptjon Is not unreasonable, as pubjic refatfons practitioners 

fxirform In sevijral roles In a typical workday,, shift Ing roles 
to accomodate organizational expectations and conditions. 

Methodology • I 

Public relations pract^i^r|^an Qlego, C^l IfiwgfJero 



. sampled. The «'9^|^^^P»he United States, tV San" Diego ' 
- ^^5A totals 1.8 mll|^p^;ip^ ^ - 

Its tanperate, 'W^^p^limate;and t,lgh cost of living. Major . 

growth^ Industries InclM|e aerospace and other hlgh^technology In^ 
tries. Four profess|ial organlzatloij? in Sah •Dlegb cooperated In this 
research project;. ^»ie Public delations Society of AmiJr lea', the Inter- 
national Assciclatlon bf Business Communicators, the l^ubl ic Relation, 
Club or San Di;go and Women In Communications, Inc. Ld." Chapter). All 
foiir oHanl2atlons^pjx,vlded mailing 'Ists. l>^ef ''p/tches'' requesting . - 
. <l"«tionna Ire completion were^n^^^ In February 1 98l , 

Because^ single comminltyw^s- surveyed, generalization this 
' study 'are suggestive of further research opportunities. Whtl* the decision 
to survey a single community comprehensively was dictated by larger Issues,*®. 
San Diego does approximate a microcosm of the nat lonal practitioner popula- 
tlo,^. A-comparlson was made of pra|tltl6ners In the present study and Broom^s 
national survey of public relations pracilt loners in 1975, using the PRSA 




membership list. In the present study, practitioners worked for non- 
profit organizations In greater numbers than In the national study 
. In San Oled'6 vs. 30% nationally). Regarding * Income, years of practitioner 
experience, tenure at present Job, media experience, age, education and 
male domination, the PRSA respondents In the present study CloselV^ resemble 
respondents to the 1979 natlonall PRSA survey. Because other professional 
associations were Included In the>esent study, the overall respondent 
characteristics differ sll'shtly from t^KJse of the national PRSA survey.' 
The present study's respondent^ jncluded more women {k2% In San Diego vs. 
28% nationally In the 1979 PRSA survey), were youngy (39 years In San 
Diego vs. nationally, on the average), earned lower annual 'Salaries 
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. ($26,98% In San O^cgo vtf. $34,355 nationally on the average) arid had 
fewer years of practitioner experience ( 9 yMrs among San Diego respon- 
dents vs. ]k years amongifespindents^of the national PRSA study). This 
underscores the common -perception of PRSA as the "elite" professional 
association f^r public relations practitioners. " 

* From the four malUng lists, ,374 practitioners "were Identified. Of 
• tlWIe, 41 were removed from the sample because they wei-e retired, becau 
had moved from the area or because they, were rtot pubUc rblatlons" 
practitioners, despite their professional affiliation. Questionnaire 
were mailed to practitioners in February; a second wave Of questionnaires 
.was sent to non-respondents March. A total of I69 questionnaires We 
completed and returned, a 50.7% response rate. 

In addition to the 24 organizational role Items and 12 evaluation 
raetjTods Items, respondents provided Information about their education^ 
professional background and experience, gender. Income, age ^d orgJit- 
zatlonal characteristics. The role and evaluation Items were measur 
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using a seven-point , LI kert^type scale; racing from "neveH^^ (I) to 
••always'^ (if. 

Responses were coded In machine-readable form for computer analysis 



and test of hypotheses. Sfudy hypotheses were: 

hp CoftinuM manager role scores are significantly correlated 

with bQjth sclent If leg end sea t -of pants evaluation methods, 

^2' Communication technician role scores .are not ^^fgnlf Icantly 
correlated with either seat-of-pants or scl^If Ic evaluation 
methods. 

••^3" Medlk relations role scores are not significantly correlated 
with either seat^of-*pants or Scientific evaluation methods. 

, •^4- Communication liaison role scores are significantly correlated 
wfth both, ^eat-of-parvts and scientific evaluation methods. 

The following decision rule was established: 

The null hypothesis Is confirmed If Its probabll Ity of accuracy Is 
equal to or greater than one chance In 100, 

The null hypothesis Is rejected If Its probability of accuracy l\ 
less than one chance In 100. i Si^ 

Organizational role scores and ev%^liatIon method and ev^luat Ibn'^ontent 
scores were computed for ^^ch respondent. Pearson iJroduct-moment correla- 
tion coefficient^ were computed for each of the four organizational role 
scores and the two methods of evaluationt scientific and seat-of-pants . 

^ . Findings V 

As Indicated In Figure 3, hypotheses h, , h2 and h^ were confirmed by 
tests of signlf Icanceb/ the Pearson product -moment correlations. HypothesI 
hj, on the other hand, was rejected according to the decision rule. 

Communication manager roIeJscores are significantly and positively 
correlated with both seat-of-pah ts and scfehtlf Ic evaluation actlvltles.^ 
Communication technician role scores are not correlated with either 
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Figure 3* 

7 • • 

• \. 

Correlation of Overall Ey^Muatton Heth^ Scores 
With 9)rganl'zat{ona'l lole Scores 
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SMt-of-pants or sclentlfk evaluatlon^acttvltfes. C pnnunlcatlon llatson 
scores ar« significantly and posltlWly correlated with jpth seat-of- 
£ants and scientlftji evaluation ac^iWtTisl These findings are consistent 
with the research hypotheses arid with the ^Interpretation of role factors. 
'They'are consistent with Inferences drawn from prior diffusion research, 
concerning the relative advanjCage, compatlbfllty, complexity and trall- 
ablllty of Innovations for practitioners playing certain organizational 
roles. 

The significant, positive relationship between media relations role 
scores and seat-of -pant s /sc I ent I f I c eva 1 uat Ion activities Is counter to 
the Interpretation of the organizational role factor and contradicts ^ 
inferences dfawn from prior diffusion research. 

. To understand tl^ls unexpected finding, correlatfews between organi- 
zational role scores yand each content component evaluation score were 
examined. ' ■ j 

^ Six evaluation activity scores can be computed, one for each cell 
cif the public relations evaluation matrix, Then, Pearson product^moment 
correlation coefficients .can be comjxited for each organizational role 
score with each evaluation con tent -met hod score. Finally, each corre- 
lation coefficient can be determined to be either statistically significant 
oY not significant, according to the decision rule. 

Figure k displays the results of these computations and statistical 
tests. As might be expected, the relations betviteen communication manager 
scores, communication technician scores and cocmfunloat Ion liaison scores 
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Figure '4. 
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Correlation of Organizational Role Sc^es with the Preparation, 
pisBemin^tion and Impact Components of thi^Evaluation Methods Scores 
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^t^^?^*^ product-moroent correlation is significant; 
.p<.01 



Pearson product-moment^corrfilation is not sigiiifl^ 
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wfth each of the six content^thod evaluation scores a^e consistent with 
the research hypotheses h,. h^ and That Is,. the positive/relationship 
between cOnnHin Icat Ion manager scores and conwuhlcat Ibn^l laXon score, are 
statistically stenlf leant for-each V the separate content areas of evalua 
tW . Ukewlse^^ no relatlop^fp exists between : xdn«Kih I cat Ion t^.h.l.t.n 
rp^e^ scores and any of the co^^nt-speclf Ic evaluatlJT activities. 

With regard ta the media relations role scores. Figure k Indicates ' 
significant, positive correlations between each of. tl)e seat-of -pants con- 
t^t-speclfJc -evaluation ac 1 1 v I fel es and med la re I anions ' ro 1 . 
fount^r^.the hypothesis, pract I^ doners with high hiedia relations rnU . 
/scores Wigacje In a'number of SMt-of-pants evaluaMnn act Ivit les.ln 

message-preparation, message dissemination and message Impact, 
y The relet lohship between media relatlonV role scores :and content- 
specific measures of scientific ev.luat Ion is Informative. With regafd - 
to evaluation In area^ of preparation and Impact, the relatl,^nshlp between 
media ri^latlony role scores and evaluation activities Is nil ] Only In. t^he ' 
area of dissemination evaluation does a strong, positive relat lonshlp^xIsV 
between role scores and sclentN^c evaluation activities. These scientific 
activities Irfclude content analysis of media messages and quantification of 
clip file statistics. Returning to diffusion research, such adoption of 

this-partlcular content area would appear consistent. In retro 
spect. with relative advantage. A practitioner playing a media relations 
role, who Is effective In placing news releases In the mass media, might see 
quantification of these successes as helpful arr,unitlon l„ feuds with others 
who want to knowj "What's PR done for me lately?" 

To flesh out the profile of the organizational roles played by public 
relations practitioners, respondents were divided Into categories of dominant 
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roles. A respondent 's danfnunt role was determined by the highest score 
among the four role scores. Because role scores are normalized, this 
process artificial W dlWdes the sample Into four roughly equal-sized 
groups. This categorization ^ Independent of the absolute frequency of 
specific activities relevant to each role score. This method does permit 
development 6f a rough profile of pract 1 1 lojier^ for each dominant role. 

Such a dominant rol.e profile Is displayed In Figure 5. Practitioners 
In each of the dpmlnant r^Ies do not differ significantly In age, education 
years of professional experience and years In their current Job.*3 \ 
practftloners do differ significantly In terms of organlzat^I position. 
Respondents were asjced to Indl'cate whether they were ranked as top manage- 
ment, middle inanagement or staff. A higher percentage of communication 
manaaers were ranked top management; a higher percentage of communication 
technicians were ranked staff. These] differences were statistically 



significant (chl square - lij.9; d.f. - 6; p<.05). 

With regard to mean Income, seat-of ^pants evalu;.f»«n scores and 

evaluation scores, comlnunlcation technlr.i,n. show significantly 

lower averages, when compared to the means of other dominant roleftypes. 
Further, the communication techni.i.n role does not appear to be a\ran- 
sltlonallVoIe, leading to better career opportunities and higher pay. 
Commun leal Ion technic ians are paid about $10,000 less each year than 
communication managers and communication ll.Uon practitioners, despite 
comparable education and professional experience. A similar problem afflicts 
the media relations practitioner: Income Is on Ij, slightly better than that 
of communication technicians. 
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Conclusions «nd JmpUcatlons for Research 

Public relations practitioners perfonn different roles In their 
organisations. Because demands of organ I ;£atlona I roles differ, some 
organizational roles are more' 1 Ikely to adopt Innovative approaches to 
•valuation of public relations activities. 

Communica tion managers , top ranked and highly paid pract It loners , 
are frequent users of both seat-of -pants, Individualistic methods of 
evaluation and scientific evaluation methods. 

Communication liaisons, middle management advisors to senior decision 
makers, are also highly paid. They are also frequent users of both scien- 
tific and seat-of-pants evaluation methods. 

Media rel ations specialists are relatively low-paid practitioners at 
the middle management and staff rank.' They frequently use seat-of-pants 
methods of evaluation In a number of content areas. TheJr use of scientific 
evaluation methods Is confined to dissemination evaluation, principally 
cl Ip file statistics. 

Communication technicians are relatWely underpaid practitioners confined 
In disproportionate numbers to the rank of lower staff. Despite comparable 
education and years of professional experience, tfiese practitioners appear 
confined to the technical aspects' of publ Ic relations; they Implement other 
people's decisions. Communication technic lar^ show no systematic pattern «f 
svaluatlon activities using either seat-o£^pants or scientific methods. Indeed 
:uxnblned evalu^lon actrvltles In both c^orles are signlf Icant^ly lower than 
similar actfmies by other types of practitioners. 

Indeed, adoption of /Innovations In evaluation appears related to success 

In public relations careers. The Pearson product-moment correlation between 

'■« . • 
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Mncoma and evaluation activities Is significant Cscrf.entlfic evaluation 
• .3Ij «eat-of-pants evaluation - .31)." 

I Beyond the scope of^thls study to date Is the mu sal determinants 

•'• ^' ' ' ■ ■ ■ 

I Of .organizat ional ro1«s, Two theoretical perspettlves seam relavant. 

I ^ Indtvldual-level cause would attribute organizational role playing 
to personal characteristics of Individual practitioners. Some practl- 
*'/?f" attl;15jide and behavioral predisposition to seUct for 

ilvet an organ fiat lonal roJe that seems fUtlng. 
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On the other hand, system-level causfcwould-«ttrlbute organizational 
le to situational v^'lables and organizational characteristics. Son^ 
organizations,. by nature of environmental factors. Internal organization . 
end perception of the PR function, simply require the practitioner, re- 
gardless of predisposition, to perform within the confines of a particular 
organizational role^ 

To test rival hypotheses suggested by Individual -level and system- 
level perspective^, organizational roles need be Studied In terms of the 
subjective perceptions of practitioners. All Indicators of roles In t1>e 
currefit study were frequencies of overt organizational behavior. What 
are the subjective attitudes and beliefs about the organization, roles 
and careers that underlie the overt behavior manifested by practitioners? 
Focus group studies provide one methodological a|prodch. Q-method and 
construction of belief system models provide another approach. 

Along other lines, practitioner roles need study with regard to the 
^•ganlzatlonal contfixt. The objective clusters of organizational behavior 
and subjective belief systems of practitioners need to be measured along 
with behavfors and perceptions of other organizational members. Analysis 
of relations between practitioner characteristics. and characteristics of 
the surrounding organization seems appropriate. « 
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